An analytical limitation for time-delayed feedback control in autonomous systems 
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We prove an analytical limitation on the use of time-delayed feedback control for the stabilization 
of periodic orbits in autonomous systems. This limitation depends on the number of real Floquet 
multipliers larger than unity, and is therefore similar to the well-known odd number limitation of 
time-delayed feedback control. Recently, a two-dimensional example has been found, which explicitly 
demonstrates that the unmodified odd number limitation does not apply in the case of autonomous 
systems. We show that our limitation correctly predicts the stability boundaries in this case. 
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When chaotic systems started to get wider scientific 
attention during the 1960s, chaos was considered to be 
a mathematically interesting concept with little practical 
applications. This has changed dramatically in the 1990s 
when Ott, Grebogi and Yorke [T] introduced a method 
to stabilize Unstable Periodic Orbits (UPOs) within the 
chaotic attractor using small perturbations. Since then, 
the subject of chaos control has been vigorously devel- 
oped mis]. 

One simple method to select a particular UPO within 
a chaotic attractor is via the time-delayed feedback con- 
trol due to Pyragas f?]. Because no detailed knowledge 
of the chaotic system or its attractor is required, this 
method proved to be easy to implement and widely ap- 
plicable [SHU]. However, it was claimed by Nakajima 
P~3] that the time-delayed feedback control is not able 
to stabilize a UPO with an odd number of real Floquet 
multipliers larger than unity. While this odd number lim- 
itation was proved in [13_ for the case of hyperbolic UPOs 
in non-autonomous systems, it was also stated that the 
same restriction should apply for the autonomous case 
"with a slight revision" (footnote 2 of US]). Over the 
following years the odd number limitation was used by 
many researchers, and it seemed to be supported by ex- 
perimental and numerical evidence even for autonomous 
systems, although in this case a strict proof was missing. 
Recently, Fiedler et al. [H] discovered a UPO in an au- 
tonomous two-dimensional system, which has precisely 
one Floquet multiplier larger than one, and can be sta- 
bilized by the time-delay feedback control scheme. This 
directly refuted the common belief that the odd num- 
ber limitation is also valid for systems without explicit 
time-dependence. Autonomous systems are by far the 
most dominating type of systems considered in nonlin- 
ear science, and time-delayed feedback control is one of 
the most practical methods for stabilizing (or destabiliz- 
ing) periodic orbits. Therefore any limitation on the use 
of time-delayed feedback control is not only important 
from an academic point of view, but also has practical 
implications for the many applications of time-delayed 
feedback in real- world systems. 

In this Letter we give an analytical condition under 



which the time-delayed feedback control is not success- 
ful in autonomous systems. Similarly to the odd number 
limitation, this condition involves the number of real Flo- 
quet multipliers larger than unity, but it is now modified 
by a term which takes the action of the control force 
in the direction of the periodic orbit into account. Our 
proof follows to a large extent the proof of the original 
odd number limitation given in |13| but now implements 
the necessary modification for the autonomous case. As 
a first application we show that our limitation correctly 
reproduces the boundaries of stability for the two dimen- 
sional system studied in |14ffTB] . which originally served 
as a counter example of the unmodified odd number lim- 
itation. 

Let us start with an uncontrolled dynamical system 
x[t) = f{x{t)) with x{t) e M" and / : M" -J> K" and 
implement the time-delayed feedback control in the form 

x{t)^ f{x{t)) + K[x{t-T)~x{t)], (1) 

where if is an n x n control matrix, and r is a positive 
parameter. If the uncontrolled system has a r-periodic 
solution X* (t) — X* {t + t) , then the form of ([T]) implies 
that X* (t) is also a solution of ([T]) for any choice of the 
control matrix K. 

In order to assess the stability of the periodic orbit 
X* (t) in the controlled case, it is convenient to first in- 
troduce the the fundamental matrix $ (t) for the uncon- 
trolled system as the solution of the initial value problem 

^{t)^Df{x*{t))^it); $(0)=I, (2) 

where Df {x* {t}) denotes the Jacobian of / evaluated at 
X* (t), and I is the n x n identity matrix. The gener- 
alized eigenvalues {/xi, . . . , /x„} of $ (r) are the Floquet 
multipliers associated with the periodic orbit x* (t) . We 
also define the matrix W {t) = {vi (t) , . . . , w„ (t)) such 
that its kth column Vk (t) G C" is given by Vk (t) = 
$ (t) Vk (0) and the set {vi (0) , . . . , w„ (0)} is a complete 
set of generalized eigenvectors of $ (r) . For each t, the 
set {vi (t) , . . . , Vn {t)} provides a local (but in general 
not r-periodic) basis at the position x* {t) along the or- 
bit. Since we consider an autonomous system we also 
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observe that x* (0) = $ (t) x* (0), i.e. one of the Floquet 
multipHers is equal to unity. It is therefore convenient to 
choose vi (t) — X* (t) and = 1. By defining 



K{t) = [W{t)r'^KW (t) 



(3) 



we transform the control matrix to this local basis. As 
we will see in the following the (1,1) component of the 
matrix K{t), which we denote by Ku (t), plays a deci- 
sive role in assessing the stability of the controlled orbit 
X* (t) . Some intuition for the quantity Ku (t) can be ob- 
tained if we expand the result of applying the control 
matrix to x* (t) in the local basis via 

n 

Kx* {t) = {t) X* {t) + Kik (t) Vk it) . (4) 

fc=2 

In loose terms we can therefore interpret the quantity 
Kii (t) as the action of the control matrix K projected 
in the tangential direction of the orbit at time t. Note 
that Kii (t) is well defined and in particular not affected 
by any reordering or rescaling of the Vk (t) for k > 2. 
Using this definition of Ku (t) we are now in a position 
to formulate the main result. 

Theorem: Let x* {t) be a r-periodic orbit of (jlj which 
for K — possesses m real Floquet multipliers larger 
than unity and precisely one Floquet multiplier equal to 
unity. Then x* {t) is an unstable solution of the time- 
delayed system ([T]) if the condition 



(-1)' 



1 



kii {t) dt] <o 



(5) 



is fulfilled. Here Ku (t) is defined as in Q. 

Before we proceed with the proof of the theorem, let 
us briefly discuss its significance. The theorem provides 
an analytical limitation on the use of time-delayed feed- 
back control, and states that time-delayed feedback can 
only successfully stabilize a periodic orbit, if the condi- 
tion (|5| is violated. We stress however that the converse 
is not implied by the theorem, i.e. a violation of ([5| alone 
does not guarantee that time-delayed feedback will suc- 
cessfully stabilize a given periodic orbit. The theorem is 
only applicable to periodic orbits with exactly one Flo- 
quet multiplier equal to one. In practice this is not a 
serious restriction, since it is fulfilled for any orbit which 
is hyperbolic in the context of an autonomous system. 

The number m of real Floquet multipliers larger than 
unity only enters in the form (— 1)™ in condition ([s]), and 
we can therefore divide the discussion into the two cases 
of odd and even m. In the case of odd m the original 
odd number limitation suggests that it is not possible 
at all to use the time-delayed feedback scheme to stabi- 
lize the periodic orbit. Our theorem now modifies this 
statement and allows for successful stabilization if the 
necessary condition 



is fulfilled. Condition ^ can therefore guide the selec- 
tion of an appropriate control matrix K, which enables 
the stabilization of periodic orbits with odd to. In par- 
ticular it is required that the average of Ku (t) along the 
periodic orbit is negative. We also note that odd to im- 
plies that the orbit is unstable in the uncontrolled case, 
and obviously ([6| is not fulfilled for K = 0. Without 
knowledge of the limitation (|6| it is difficult to construct 
a suitable control matrix K and this might explain why 
numerical and experimental evidence seemed to wrongly 
indicate that the original odd number limitation [13J is 
also valid in the autonomous case. 

In contrast to previous results, the condition ([5| also 
provides a limitation in the case of an even number m 
of real Floquet multipliers larger than unity. In this case 
an orbit can only be stabilized if the limiting condition 



kii {t)dt > -1 



(7) 



is fulfilled. Note that this condition is automatically ful- 
filled for K = Q and therefore only provides a limitation 
on time-delayed feedback control in the large coupling 
regime. Condition ([T]) is however also useful, if it is de- 
sired to destabilize a stable periodic orbit using time- 
delayed feedback. This can be achieved by a control ma- 
trix K which violates ([t]). 

Let us now proceed with the proof of the theorem, 
which uses many ideas from |13| but now takes particular 
consideration of the autonomous case. The essential tools 
in the proof are the two functions F [v) and G [v) defined 

by m 



G [v) = det [vl - $ (r)] 
F {v) = det [vl - (t)] 



(8) 
(9) 



where (t) solves the initial value value problem 

vi/, (t) = [Df {x* (t)) + {v-' - 1) K] it) , (10) 
*.(0) =1. 

By direct differentiation it can be verified that the solu- 



tion of (10 1 can also be expressed as [13] 



Kii (t) dt < -1, 



(6) 



^'^(t) = $(i) I+(i/-i-l) / (u)is:«', (u)dw 

L Jo 

(11) 

In order to prove the theorem let us first show the 
following lemma: 

Lemma: If for a given r-periodic orbit x* (t) with pre- 
cisely one Floquet multiplier equal to unity the condition 
F' (1) < holds, then x* (t) is an unstable solution of the 
time-delayed system ([T|. 

Proof of the Lemma: From ( 10 1 it follows that 
vJ/jy (t) is bounded in the limit of — > +oo, and there- 
fore ([9]) implies that F (v) w j/" +00 in the limit 
of — !■ +00. In an autonomous system we know that 
/ii = 1 is an eigenvalue of $ (r) and it therefore follows 
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from (|8| that G (1) = 0. But since from (|T0| it fol- 
lows that *i (t) = $ (t) we also have F (1) = G (1) = 0. 
Thus F (v) is a continuous function, which vanishes at 
1^ = 1, has a negative slope at v — 1, and diverges to -|-c» 
for large v. By the intermediate value theorem there 
exists at least one i^c > 1 with F {vc) = 0. From Q 
it then follows that there exists a vector Wc (0) G M" 
with "^^^ (r) Wc (0) = 1^1, Wc (0) and we can define Wc (t) — 
'i'ua (t) (0). Using this definition of Wc [t) and the fact 
that Wc {—t) — v~^Wc (0) it is straightforward to check 
that the function x (t) = x* {t)+eWc {t) solves the original 
time-delayed system ([ij up to first order in e. However, 
since Vc > ^ and wdkr) = f^Wc(O), the term ewc{t) 
grows exponentially in time, and therefore x* {t) is an 
unstable solution of the time-delayed system ([T|). This 
completes the proof of the lemma. 

Proof of the Theorem: To complete the proof of the 
theorem, it now remains to show that the condition ^ 
implies that F' (1) < 0. Under this condition the above 
lemma then implies that the orbit x* (t) is unstable and 
thereby proves the theorem. Since F (1) = we can write 
F' (1) = hm^^o Fi^ + e-) /e- To assess the sign of F' (1) 
it is therefore necessary to evaluate F (1 -I- e) up to first 
order in e. According to ^ we can achieve this by first 
evaluating (t) at = 1 + e. Using the representation 
(111 we write 



+ , (i) - $ (t) 



1 + e Jo 



{u) K^i+, (u) du 



O(e') 



-e [ {u)K<i>{u)du 
Jo 

Then in first order of e we obtain from ^ 

F (1 + e) = dot [M" + eM^] (12) 



where we have defined the two matrices 



A'f 



$1 



Afi = I + $ (r) /" (u) if$ (u) du. 
Jo 

We can now use the previously defined matrix W (0) , 
whose columns Vk (0) form a complete set of the general- 
ized eigenvectors of $ (r). We did not yet fix the scaling 
and order of the Vk (0) for A: > 1 previously, and we can 
now choose generalized eigenvectors in such a way that 
the matrix $ (r) = (0)"^ $ (r) W (0) is in the Jordan 
normal form. Transforming the argument of the deter- 



minant in (12 1 to this basis we obtain 



F(l 



det 



eM^)W{0) (13) 



det 



I - $ (r) + e I + $ (t) / K{u) du 



(14) 



where we have used W{0) ^$-1 (u) A'$(u)M^(0) = 
W {u)~^ KW (u) = K (u) . Using the Jordan normal 
form of <l> (r) and the fact that /^i = 1 we find 



<I(t) 



/ 

1 — /i2 * 



Vo 



\ 



(15) 



I -fin/ 



where the entries indicated by * can be either or — 1. 
Since all entries in the first column and first row of the 
matrix I — $ (r) vanish, the only contribution to the de- 
terminant (|14|) up to first order in e is given by 



F (1 + e) - e f I + $ (r) / K (u) du] JJ (1 - t^k) 

V -'O /(l,l)fc=2 

^e(l+ f kn{u)du)f[{l-fik). 

The product nfe=2 ~ Mfc) does not vanish, since it was 
assumed that fix — 1 is the only Floquet multiplier equal 
to unity. Each real Floquet multiplier larger than unity 
contributes a negative factor to this product, while pairs 
of complex conjugated Floquet multipliers or real Flo- 
quet multipliers smaller than unity do not change its sign. 
We can therefore write sgn (nfe=2 (1 ~ A^fc)) = (^1)™ and 
conclude that 

F'(l) < ^ (-1)" ( 1+ / Ku{u)du]<0. 



This means that condition ^ implies a negative F' (1) 
and it then follows from the lemma that x* (t) is unstable. 
This concludes the proof of the theorem. 

Let us now compare our theorem and its proof with 
the proof of the original odd number limitation (theorem 
2 in [13]), which states that a hyperbolic UPO of a non- 
autonomous system with an odd number m of real Flo- 
quet multipliers larger than unity can not be stabilized 
using time-delayed feedback control. We stress that the 
term hyperbolic orbit in the context of a non-autonomous 
system means that the orbit has no Floquet multipliers 
equal to unity. In contrast, for an autonomous system the 
term hyperbolic orbit denotes an orbit with precisely one 
Floquet multiplier equal to unity |17j . In other words, 
while any autonomous system can be trivially associated 
with a non-autonomous system of arbitrary period, any 
hyperbolic orbit in the autonomous system becomes a 
non-hyperbolic orbit in the associated non-autonomous 
system. The proof in [T3] uses the functions G (v) ^ 
and F (v) ^ . Under the condition that all Floquet mul- 
tipliers differ from one, it can be seen from the expression 
F (1) = G (1) = nLi (1 - Aifc) that F (1) < for odd to. 
From the fact that lim,y_j.oo F (ly) — +oo it then follows 
that there exists a fc'c > 1 with F (i/c) — 0. Similar to 
our proof it is then shown in |13| that this implies that 



4 





0.15 - 








0.10 - 








0.05 - 








0.00 - 




-0.05 - 




1 \ 
\ \ 
" \ \ 
\ \ 


1 1 / 1 
I 

1 .* - 

/ 


- \ \ 


/ .■■ 


\ \ 


/ .' 


\ \ 


/ •■ 




V /.' / 


\ 


\ / 


\ 









0.6 0.8 1.0 1.2 1.4 0.6 0.8 1.0 1.2 1.4 



Figure 1. The functions G(y) (solid lines) and F (y) (dashed 
lines) and the slope f ' (1) (dotted lines) for the system defined 
in (i6l. The parameters are = 0.02, 7 ■ 



-10, r : 



and /3 = ^. For the control strength parameter we use &o 
0.01 (left hand panel) and 60 = 0.04 (right hand panel). 



the periodic orbit is an unstable solution of the time- 
delayed feedback system. We therefore conclude that the 
odd number limitation as stated in theorem 2 of [13 is 
formally correct if the term hyperbolic is understood in 
the context of non- autonomous systems. However, this 
hyperbolicity condition is explicitly violated in the au- 
tonomous limit and the odd number limitation makes no 
statement for systems without explicit time dependence, 
which is by far the most significant case in practice. 

The first autonomous example, where a UPO with 
odd m was stabilized using time-delayed feedback control 
was given in [14 and provided a counter example which 
showed that the original odd number limitation can not 
be applied to the autonomous case without modification. 
It is therefore important to check that our limitation ^ 
correctly handles this case. Let us consider the dynami- 
cal system for z (t) G given by [14, 15J 



J- 



+bo 



(1 + J7)(|z(t)| = 



cos /3 — sin /3 
sin /3 cos f3 



[zit- 



z{t) 

z{t)] (16) 



with the four real parameters r > 0, i? > 0, 6o > 0, 

/3, and using 7 = ^ - I) ?md J = ^ ^ ^ 

For 60 = we find the r-periodic orbit z* (t) = 
R (cos (27rt/r) , sin (2-Kt/T))^ . A short calculation shows 
that the two Floquet multipliers are given hy = 1 and 
H2 = exp {2R^t) > 1 which implies m ~ 1. The local 
basis functions can be expressed as vi [t) — z* [t] and 
V2 (t) — exp {2R^t) (z* (t) + 7^z* (i)) and we can then 
use ([4]) to calculate Kw (t) — bo (cos (3 + 7 sin (3) . For a 
successful stabilization condition ^ therefore requires 
that 



This agrees with the previous stability condition given in 
|15| . In this example it is possible to explicitly calculate 
the functions F (u) and G (ly) which are defined by ^ 
and (|9|, respectively. In the left hand panel of Fig. [ijthe 
corresponding plots are shown for a relatively low value 
of the control strength 60, where the condition ( [l7| is 
not fulfilled. In this case we observe that F (1) = and 
the slope F' (1) is negative. Therefore the function F {i/) 
needs to cross the zero axis at a point larger than unity 
and the periodic orbit is unstable. In the right hand 
panel of Fig. ([T]) the control strength bo is big enough to 
satisfy condition ( [T7| . Then the slope F' (1) is positive 
and the function F (i/) does not cross the zero axis at 
values larger then unity. This is a necessary condition 
for the stability of the periodic orbit under time-delayed 
feedback control. 

In conclusion, we have proved an analytical limita- 
tion on the use of time-delayed feedback control in au- 
tonomous systems. This limitation depends on the num- 
ber of real Floquet multipliers larger than unity, and on 
the quantity Kn (t) defined in equation which quan- 
tifies the action of the control matrix in the direction of 
the orbit. While the limitation is valid for arbitrary di- 
mensions, we have demonstrated its usefulness in a well 
studied two-dimensional system, for which the original 
odd number limitation does not apply. The knowledge 
of this limitation will provide an important guidance for 
the design of time-delayed feedback implementations in 
practical applications. 

This work was supported by Science Foundation Ire- 
land under Grant Number 09/SIRG/I1615. 



60 (cos/3 -I- 7sin/3) T < — 1. 



(17) 



[1 
[2 
[3 

[5 
[6 

[8 

[9 
[10 

[11 
[12 



* la.amann@ucc.iel 

E. Ott, C. Grebogi, and J. A. Yorke, Phys. Rev. Lett. 



64, 1196 (1990). 

E. SchoU and H. G. Schuster, eds.. Handbook of Chaos 
Control, 2nd ed. ( Wiley- VCH, Weinheim, 2007). 

S. Boccaletti, C. Grebogi, Y. C. Lai, H. Mancini, and 

D. Maza, Phys. Rep. 329, 103 (2000). 

K. Pyragas, Phys. Lett. A 170, 421 (1992). 

K. Pyragas and A. Tamasevicius, Phys. Lett. A 180, 99 

(1993). 

W. Just, T. Bernard, M. Ostheimer, E. Reibold, and 
H. Benner, Phys. Rev. Lett. 78, 203 (1997). 
D. W. Sukow, M. E. Bleich, D. J. Gauthier, and J. E. S. 
Socolar, Chaos 7, 560 (1997). 

M. G. Rosenblum and A. S. Pikovsky, Phys. Rev. Lett. 
92, 114102 (2004). 

S. Schikora, P. Hovel, H. J. Wiinsche, E. SchoU, and 

F. Henneberger, Phys. Rev. Lett. 97, 213902 (2006). 

J. Sieber, A. Gonzalez-Buelga, S. A. Neild, D. J. Wagg, 
and B. Krauskopf, Phys. Rev. Lett. 100, 244101 (2008). 
M. Tlidi, A. G. Vladimirov, D. Pieroux, and D. Turaev, 
Phys. Rev. Lett. 103, 103904 (2009). 
A. Englert, W. Kinzel, Y. Aviad, M. Butkovski, L Rei- 
dler, M. Zigzag, I. Kanter, and M. Rosenbluh, 



5 



Phys. Rev. Lett. 104, 114102 (2010). 
[13] H. Nakajima, Phys. Lett. A 232, 207 (1997). 
[14] B. Fiedler, V. Flunkert, M. Georgi, P. Hovel, and 

E. Scholl, Phys. Rev. Lett. 98, 114101 (2007). 
115] W. Just, B. Fiedler, M. Georgi, V. Flunkert, P. Hovel, 

and E. Scholl, Phys. Rev. E 76, 026210 (2007). 



[16] V. Flunkert and E. Scholl, Phys. Rev. E 84, 016214 

(2011). 

[17] Y. A. Kuznctsov, Elements of Applied Bifurcation The- 
ory, 3rd ed. (Springer, New York, 2004). 



